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ABSTRACT 



Three research studies examined the impact of environmental 
interpretation programs on the environmental knowledge, attitudes, and 
behaviors of student participants. Conducted by Indiana University's 
Department of Recreation and Park Administration, the studies evaluated 
variables related to entry level (awareness) , ownership, and empowerment 
goals in a behavior change model of environmental interpretation. In the 
first study, approximately 600 students in grades 3-4 participated in the 
Hilltop Interpretation Project during half-day field trips to the Hilltop 
Garden and Nature Center (Bloomington, Indiana) . In the second study, 
approximately 1,600 urban students in grades 4-5 participated in two 
interpretive field trips to Indiana Dunes National Seashore, one focused on 
ecology awareness and the other on awareness of environmental issues. In the 
third study, a partnership of educational institutions in south- central 
Indiana sponsored a year-long five -phase environmental education program for 
middle school teachers and students intended to promote involvement in the 
management of the heavily utilized Charles Deam Wilderness. Results of pre- 
and post tests indicate that entry-level variables had more short-term impact 
on students than ownership and empowerment variables. All interpretive 
experiences based on ecological information increased student knowledge, but 
only the ecological field trip at Indiana Dunes affected student attitudes 
and behavioral intentions. Interpretive experiences with ownership and 
empowerment variables had no effect on student attitudes and behavior. (SV) 
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Evaluating the Impact of Environmental Interpretation: 
A Review of Three Research Studies 

Doug Knapp 

Assistant Professor 
Indiana University 



This paper reviews three research studies that looked at the impact an interpretive experience has 
on knowledge, attitude, and/or behavior of a park visitor, research methodologies, Imutations, and 
conclusions were discussed for all three studies. 



Keywords: Environmental interpretation, evaluation, environmental education, knowledge/- 

attitude/behavior change 



Introduction 

The fifth principle of interpretation defined 
by Freeman Tilden is to provoke visitors to be- 
come preservationists of the park they visit 
(Tilden, 1957). This lofty goal is supported by a 
significant proportion of interpreters and will be 
used by the author to define environmental in- 
terpretation. ^ Despite the interest and impor- 
tance of this particular interpretive endeavor, the 
field has lacked an established framework of 
goals to achieve this behavior change. 

Several studies have been conducted in the 
related field of environmental education to 
analyze and identify key variables that are asso- 
ciated with attitude/behavior change. Research 
conducted by Borden and Powell (1983), Hines 
(1987), Holt (1988), Hungerford and Volk 
(1990), Marcinkowski (1989), and Sia, Hunger- 
ford, and Tomera (1985/86) revealed that there 
are probably three categories of variables that 
contribute to environmental behavior: entry 
level, ownership and empowerment variables. 



* A communication process for revealing meanings 
and information of natural resources and their rela- 
tionships with man with an ultimate aim of chang- 
ing a visitor’s behavior toward the resource site 
and beyond. 



Combining the above research wth a syn- 
thesis of over 100 goals and objectives of inter- 
pretation, the author produced a framework of 
goals and objectives for environmental inter- 
pretation. This framework was evaluated and 
supported by a panel of interpretive leaders 
throughout North America. The result of this 
validation process is the Environmental Inter- 
pretation Behavior Change Model (Knapp, 
1994) illustrated in Figure 1. 

The most powerful use of this model is to 
offer interpretive experiences that include all 
three variable levels in a sequential hierarchical 
order. Although this may not assure attitude or 
behavior change in the visitor, it does offer op- 
portunities to stimulate change. It is important 
to note that, with the exception of issue investi- 
gation goals, all of the directives listed in the 
above model are outcomes often found in the 
interpretive literature. 

The development of this model is an attempt 
to offer to the field a “road map” to achieve 
knowledge, attitude, and/or behavior change in a 
park visitor. It is a framework in which the field 
can attempt to evaluate which variables are 
more successful in achieving this behavior 
change goal. For the past three years, Indiana 
University’s Department of Recreation and Park 
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Entry Level Goals ■§■ Ownership Goals ■§■ Empowerment Goals 



* Infonnation / Awareness 
of Site 

* Understanding of Site 

* Awareness of Site 
Policies 



* Resource Site Issue 
Awareness 

* Resource Site Issue 
Investigation and 
Evaluation 



* Promote Positive / 
Responsible 
Environmental Actions 



Environmental Sensitivity 



Visitor Behavior Change 



Figure 1. Environmental Interpretation Behavior Change Model 



Administration has been conducting three multi- 
year research studies to evaluate one or more of 
the variables outlined in the behavior change 
model. The remainder of this paper will summa- 
rize the methodologies and results of the first 
year of these evaluations. 

The Hilltop Interpretation Project 
Purpose of Study 

The primary goal of the Hilltop Interpreta- 
tion Project was to evaluate the impact an eco- 
logical interpretive program has on the envi- 
ronmental knowledge, attitude, and/or behavior 
of third and fourth grade students. This repre- 
sents the first goal level of the Environmental 
Interpretation Behavior Change Model. 

A second goal of the Hilltop Interpretation 
Project was to enable urban and rural children in 
south central Indiana to participate in environ- 
mental/conservation education programs at the 
Hilltop Garden and Nature Center. This facility 
is located in the city of Bloomington on the 
campus of Indiana University. 



Methods and Procedures 

The Hilltop Interpretation Project offered 
several innovative approaches toward the devel- 
opment, application, and evaluation of environ- 
mental interpretation. An outline of these proce- 
dures follows: 

Selection of Program 

Through a series of meetings with partici- 
pating school teachers and agency officials, an 
interpretive program was developed that an- 
swered the needs of the teachers’ class curric- 
ula. The actual experiences and activities used 
in these programs were taken from existing en- 
vironmental/conservation resources such as 
Project Learning Tree, Project Wild, and OBIS 
(Outdoor Biological Instructional Strategies). 
The subject matter contained in the interpretive 
experience focused on plant adaptations. This 
was an important science concept that both the 
third and fourth grade students were learning 
through the Science Curriculum Improvement 
Study (SCIS). 

Pro gram Implementation 

During the fall and spring of the 1993-94 
school year, approximately 30 third and fourth 
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grade classes (600 students) from south central 
Indiana participated in conservation/environ- 
mental education activities at the Hilltop Inter- 
pretive Center. These interpretive programs, 
which lasted for a half day, were led by an envi- 
ronmental education specialist. 

Prior to the field trip, each participating 
teacher was required to take part in a day-long 
training that accomplished two objectives. First, 
all pre and post lessons to be implemented by 
the teacher were offered in a participatory fash- 
ion. Second, the educators were made aware of 
the research associated with this program and 
the evaluation instrument teachers would ad- 
minister to students. 

Pro gram Evaluation 

An evaluation of the classes’ participation 
in these interpretive programs took place from 
the onset of their experience. A quasi- 
experimental design was used to conduct this 
research. This field research model approxi- 
mates the conditions of a true experiment in a 
setting which does not allow for control of all 
variables (Isaac and Michael, 1990). A test was 
administered to students prior to any pre-field 
trip lessons. A pre-visit test was given before 
their visit to the Hilltop facility and a post-test 
was administered to students at the school fol- 
lowing the experience. These evaluations, which 
were approved by the teachers, measured any 
knowledge and/or attitude change that resulted 
from students’ participation in the interpretation 
program at Hilltop. 

The Hilltop Interpretation Project had two 
distinct phases — the fall and spring evaluation 
sessions. The fall semester was considered a 
pilot study; it evaluated approximately 230 third 
and fourth graders’ experiences at Hilltop. The 
evaluation instrument used for the pretest, pre- 
visit test, and post-test was revised following 
the pilot study during the fall semester. This 
instrument was a partial replication of evalua- 
tion tools designed by the National Science Re- 
sources Center (1993) to measure knowledge 
and attitude changes in elementary school stu- 
dents. This instrument contained nine multiple 
choice and true/false questions. The revised in- 



strument and evaluation process were then ad- 
ministered during the spring semester. 

During the spring semester, over 300 third 
and fourth grade students participated in the 
Hilltop Interpretation Project. Each student 
completed a pretest, pre-visit test, and post-test. 
A chi-square analysis was conducted on the 
multiple choice questions due to the nominal 
data. This analysis determined if a relationship 
existed between the time the students took the 
test and the responses they selected. F tests were 
run on the true/false questions to determine if 
there were any significant changes in scores 
between the first, second, and third tests. 

Conclusions and Discussion 

The results show significant changes in stu- 
dents’ knowledge of plant adaptations after their 
interpretive experience. All knowledge-related 
questions showed some significant increase in 
scores following the Hilltop program. The atti- 
tude related questions showed no significant 
difference. These data support the notion that an 
interpretive experience can aid student’s aware- 
ness in science/ecological subject matter. It does 
not support the notion that such a short experi- 
ence can affect student’s attitude toward that 
subject matter. 

INDIANA Dunes National Lakeshore/ 
INDIANA University Environmental 
Education Partnership 

Purpose of Study 

The primary goal of the first year of this two 
year study was to evaluate impacts that two 
separate environmental interpretive programs 
have on students’ environmental knowledge, 
attitude and/or behavior. This project provided 
two environmental interpretative field trips to 
approximately 1600 fourth and fifth grade urban 
students. Second, it provided environmental 
education training to the 65 participating teach- 
ers. A third outcome of this project yielded an 
intensive evaluation of students’ interpretive 
experiences. This evaluation compared the ef- 
fects of two different programs representing two 
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variable levels of the Environmental Interpreta- 
tion Behavior Change Model: awareness of 
ecology and environmental issue awareness. 

Methods and Procedures 
Selection of Programs 

During the summer of 1994, representatives 
of Indiana University worked closely with staff 
at the Paul H. Douglas Environmental Educa- 
tion Center, at Indiana Dunes National Lake- 
shore, to determine which programs currently 
being offered at the Douglas Center would be 
suitable for inclusion in the study. After a thor- 
ough examination, “Fall Fanfare” was chosen as 
the ecology-based program. This program fo- 
cused on preparations and adaptations animals 
and plants make to survive the winter. Objec- 
tives of the program were met through a series 
of activities on a guided walk through a forested 
dune area. 

The “Celebration Earth” presentation was 
chosen as the issue-oriented program. Through a 
series of four activities conducted at the Doug- 
las Center, students were presented with prob- 
lems of and possible solutions to water pollu- 
tion. The programs were designed by the Na- 
tional Park Service staff at the Douglas Center 
and have been presented to thousands of stu- 
dents over the past ten years. 

Pro gram Implementation 

At the beginning of the 1994-95 school 
year, 65 teachers (representing approximately 
1600 students) from the Duneland, East Chi- 
cago, and Gary, Indiana school districts were 
contacted and asked to participate in a study that 
would provide the opportunity to attend fall and 
spring workshops. The teachers were also in- 
formed that their classes would be able to par- 
ticipate in ranger-guided fall and spring envi- 
ronmental interpretation field trips. 

At the day-long training workshops teachers 
participated in programs their students would be 
attending later in the semester. Pre-site and 
post-site activities developed by the National 
Park Service were demonstrated for teachers in 
a hands-on presentation. Teachers signed up for 



field trips during the workshop insuring that 
each class would be able to participate at a time 
convenient to their schedule. Evaluation instru- 
ments, testing forms, and return envelopes were 
provided to teachers to facilitate high response 
rates for the program evaluations. 

Program Evaluation 

To evaluate the impact the programs had on 
students’ knowledge, attitudes, and behavior 
toward the environment, a quasi-experimental 
design (Isaac and Michael, 1990) was imple- 
mented using an evaluation instrument that in- 
cluded fifteen matching, multiple choice, and 
Likert scale questions. This was a replication of 
an evaluation tool developed by Drake and 
Knapp (1994) and the National Science Re- 
sources Center (1993). During the fall, teachers 
administered the test before they began pre-site 
activities (the initial test), before the class at- 
tended the “Fall Fanfare” program (the pre-test), 
and after the class attended the program (the 
post-test). All tests in the study were given in 
the classroom and then sent to Indiana Univer- 
sity for analysis. 

During the spring teachers were asked to 
administer the test twice, once before the 
“Celebration Earth” program (the pre-test) and 
once after the “Celebration Earth” program (the 
post-test). The evaluation instrument remained 
the same throughout the fall and spring sessions. 
A majority of teachers administered the evalua- 
tion which provided a large sample of student 
responses for analysis. Two teachers volun- 
teered to act as control groups. 

T-tests for independent samples was used to 
analyze the Likert scale and matching questions 
which measured any attitude and/or knowledge 
change. This analysis was chosen to determine 
if the difference in responses over time was sig- 
nificant. It was also chosen due to the variability 
in teacher consistency in returning the evalua- 
tions. A chi-square analysis was conducted on 
the multiple choice questions due to the nominal 
data. This analysis determined if a relationship 
existed between the time the students took the 
test and the responses they selected. 
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Table I 

Significant Results from Indiana Dunes Study 



Ecology-Based Interpretive Program 


Issue-Based Interpretive Program 


• Positive increase in attitude toward Indiana Dunes 


• Decrease in positive attitude toward the Indiana 


(between initial test and pre-test only). 


Dunes. 


• Positive increase in attitude toward staying on 


• Decrease in positive attitude toward staying on 


marked trails. 


marked trails. 


• All ecology-based questions (5) showed significant 


• No positive increase in ecology scores but higher 


positive increases. 


pre-test means than in fall. 


• More students moved toward organizing protest to 


• Fewer students would form petitions to protect 


protect park. 


park. 


• Positive increase in attitudes toward the forests. 

• More students would attend guided park walks. 


• Fewer students would organize friends to take ac- 
tion to protect park. 

• Fewer students would attend guided park walks. 



Conclusions and Discussion 
Conclusions 

Table 1 shows a summary of significant re- 
sults found in this study. These results tend to 
suggest that an ecology-based program produce 
more immediate positive changes in students’ 
knowledge, attitudes, and behavior intent than 
an issue-oriented program. The analysis of the 
fifteen question evaluation instrument revealed 
ten favorable changes and no unfavorable 
changes in relation to the ecology-based pro- 
gram. There were no positive changes and five 
unfavorable changes associated with issue-based 
presentation. 

Discussion 

There were several limitations related to this 
study that must be reviewed. First, the evalua- 
tion instrument only measured short-term reten- 
tion. The pre and post-tests were administered 
within one to two weeks prior to and after the 
field trips. This was done to alleviate other vari- 
ables from influencing student responses and to 
isolate the immediate impact of the field trip. 
Therefore, this analysis of short term effect can- 
not support actual behavior change. Rather, this 
study can report on behavior intent through the 
pre and post-test evaluation. 



Another important limitation was that the 
fall interpretive experience was conducted in the 
outdoors where as the spring session was con- 
ducted primarily indoors. Although the spring 
session contained hands-on experiences for stu- 
dents, the possibility does exist that negative 
results from this session were motivated by lack 
of outdoor activities. If this limitation is valid, it 
should still be noted there was a clear difference 
in students’ reaction to indoor vs. outdoor inter- 
pretive experiences. 

These limitations must be considered when 
interpreting the results of the first year of this 
study. This research does not completely vali- 
date ecological-based programs nor does it ne- 
gate the importance of issue-based interpretive 
experiences. Several changes in the research 
will take place during the second year to in- 
crease the validity of the evaluation instrument 
and application of the interpretive programs. 
These changes will produce a more accountable 
study. 

South Central Indiana Environmental 
Education Partnership Project 

Purpose of Study 

The primary goal of the South Central Indi- 
ana Environmental Education Partnership Proj- 
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ect was to evaluate effects of interpretive pro- 
grams on students’ environmental knowledge, 
attitudes, and/or behavior. This partnership rep- 
resents all of the goal levels associated with the 
Environmental Interpretation Behavior Change 
Model outlined at beginning of this paper. The 
South Central Indiana Environmental Education 
Partnership Project was composed of three pri- 
mary institutions. They were: 

• Indiana University-Department of Recrea- 
tion and Park Administration 

• United States Forest Service-Hoosier Na- 
tional Forest 

• Monroe County Community School Corpo- 
ration 

This project formed a partnership with the re- 
gion’s educational institutions to provide envi- 
ronmental education to middle school teachers 
and students and to promote their involvement 
in the management of Charles Deam Wilder- 
ness. This site, located in south central Indiana, 
is one of the most utilized wilderness areas in 
the country. 

Methods and Procedures 
Selection of Programs 

To accomplish the partnership’s objectives, 
five environmental interpretive programs or 
phases were developed to integrate into middle 
school curricula during the academic year. Each 
phase included one teacher training day, an in- 
terpretive field trip, and related classroom les- 
sons. 

The program was intended to be used with 
science and social studies curricula creating a 
year-long environmental education program. 
Below is a brief description of each phase of the 
program: 

• Phase Ul-Basic Knowledge of Wilderness 
Site: Focused on basic ecological principles 
regarding south central Indiana ecosystems, 
as well as the natural and cultural history of 
the Deam Wilderness. 

• Phase U2-Awareness of Problems and Is- 
sues Related to Wilderness Site: Students 



learned about problems and issues associ- 
ated with the Deam Wilderness by analyz- 
ing some wilderness site issues. 

• Phase #3-Investigation of Wilderness Site 

Issues: Strategies and methods were 

planned so that students could investigate 
Deam Wilderness issues. 

• Phase H4-Knowledge of Citizen Participa- 
tion Skills: Students determined implemen- 
tation strategies to remediate the wilderness 
issues. 

• Wilderness Summit: All of the participating 
students met with U.S. Forest Service offi- 
cials to report recommendations regarding 
management of the Deam Wilderness. 

Program Implementation 

Each of the above program phases included 
teacher training and classroom lessons as well 
as an interpretive aspect such as a field trip or 
class visit by a Forest Service/Indiana Univer- 
sity Interpreter. These programs represented one 
full school year with phases one and two occur- 
ring in the fall semester and phases three and 
four in the spring semester. Five teachers, repre 
senting 150 middle school students, were cho- 
sen to take part in this project. 

Pro gram Evaluation 

Below are two areas that were evaluated in 
this project: 

• Does the partnership project affect students’ 
knowledge, attitudes, and/or behaviors to- 
ward the Deam Wilderness and related envi- 
ronmental issues? 

• Which one of the environmental education 
phases has the most impact (if any) on stu- 
dents’ knowledge, attitudes, and/or behav- 
iors toward the Deam Wilderness and re- 
lated environmental issues? 

To investigate these questions, a quasi- 
experimental design (Isaac & Michael, 1990) 
was implemented which included an evaluative 
instrument developed by Indiana University. 
This took the form of a series of pre- and post- 
tests administered to all participating students. 
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Table 2 



Timing and Placement of Evaluations 

Pre-Evaluation Pre-Evaluation Pre-Evaluation Pre-Evaluation 
General Phase #1 Phase #2 Phase #3 Phase #4 General Posttest 

Pre-test Post-Evaluation Post-Evaluation Post-Evaluation Post-Evaluation 



These evaluations were approved by the teach- 
ers and measured any knowledge and/or attitude 
change due to their participation in this envi- 
ronmental education project. This evaluation 
was a modification of instruments developed by 
Ramsey (1981), Klingler (1981), and Drake and 
Knapp (1994). This was a 20-item instrument 
that used Likert scale and multiple choice ques- 
tions. Table 2 shows a chart that illustrates the 
placement of these evaluations. 

The general pre- and post-test was an at- 
tempt to answer the first area of importance to 
this study — does the project as a whole make 
any impact on students’ knowledge and/or atti- 
tudes toward the Deam Wilderness issues? The 
pre and post evaluations for all phases attempted 
to find out which part of the program had the 
most impact. Each question was analyzed by 
using a matched pairs t-test to determine if the 
difference in responses over time was signifi- 
cant. 

Another important aspect of this project was 
the qualitative evaluation. Through first-hand 
observations, the research team was able to de- 
termine a great deal about students’ knowledge, 
attitudes, and behavior with respect to the Deam 
Wilderness. The Indiana University educators 
also conducted a series of interviews with the 
participating classroom teachers during and af- 
ter the partnership project. 

Conclusions and Discussion 
Conclusions 

Of the three variables (knowledge, attitude, 
and behavior) evaluated through the quantitative 
measures, only knowledge questions showed 
significant increases during the year-long pro- 
gram. In fact, this increase occurred primarily 
during the first phase of the partnership project. 



The attitude and behavior variables did not re- 
flect a significant increase. 

The qualitative evaluation also showed 
mixed findings. The comments from both stu- 
dents and teachers during the first two phases 
were generally positive. On the other hand, 
comments from the second two phases showed 
frustration with students’ interest in researching 
wilderness issues. The most dramatic qualitative 
results occurred with students’ interest in Forest 
Service officials’ statements during the wilder- 
ness summit. 

Discussion 

An important lesson from this project was 
over-testing of students through quantitative 
evaluations. It became clear after two phases of 
testing, students responses were reflecting “test 
burnout.” Another important finding was that 
future interpretive partnerships should look at 
semester or month-long experiences. A full 
school year was too long with both qualitative 
and quantitative findings showing a decrease in 
interest. 

Summary 

The three research studies outlined above 
are initial attempts to validate or disprove the 
environmental interpretation “road map” de- 
scribed at the outset of this paper. Many limita- 
tions existed in these studies and were discussed 
with each research summary. Despite these con- 
cerns the author believes there are two impor- 
tant observations that can be made regarding 
these three studies and their bearing on the En- 
vironmental Interpretation Behavior Change 
Model. 

1) Entry level variables showed more short- 
term impact on students than ownership or 
empowerment variables. All three research 
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studies showed significant increases on stu- 
dents’ knowledge of the resource site in- 
volved in that particular study. This, how- 
ever, was only true for the interpretive expe- 
riences that were based on ecological in- 
formation. The Hilltop program, the eco- 
logical field trip at Indiana Dunes, and the 
"first phase of the wilderness field trips all 
showed significant increases in student 
knowledge. Only the ecological field trip at 
Indiana Dunes showed any impact in stu- 
dents’ attitudes and behavior toward the re- 
source site. 

2) Interpretive experiences with ownership and 
empowerment variables showed no signifi- 
cant impact on students ’ attitude and/or be- 
havior intent toward the resource site. The 
issue-oriented field trip at Indiana Dunes 
and the three phases of the Deam Wilder- 
ness project that represented ownership and 
empowerment variables showed no signifi- 
cant impact on students’ attitude toward 
and/or behavior intent regarding the re- 
source site. In fact, some scores showed a 
decline in attitude and/or behavior toward 
the resource site following ownership/em- 
powerment experiences. 

The first year’s results of these three studies 
indicate that the initial variables of the Envi- 
ronmental Interpretation Behavior Change 
Model may have impact on a visitor’s knowl- 
edge of the resource site. However only the In- 
diana Dunes study found these variables to have 
impact on a visitor’s attitude or behavior. No 
other significant results were found in any other 
variable level. 

Research supports the notion that short-term 
awareness experiences do not change an indi- 
vidual’s behavior, which is the ultimate goal of 
environmental interpretation. Unfortunately, the 
studies reviewed above only support success in 
conveying knowledge variables. Therefore, an 
inference from this data would support the no- 
tion that environmental interpretation should 
take a hard look at its lofty goal of provoking a 
visitor to become a preservationist of his/her 
resource site. The field must further investigate 



if and how interpreters can successfully convey 
ownership and empowerment variables to at- 
tempt to achieve the widely espoused behavior 
change outcome. 
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